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This study employs data from both kindergarten cohorts of the Early Childhood Longitudinal Study 
(n ~ 12,450 in 1998; n ~ 11,000 in 2010) to assess whether associations between preschool participation and 
children’s academic and behavioral outcomes—both at school entry (Mage = 5.6 years in both cohorts) and 
through third grade—have changed over time. Findings are strikingly similar across these two, nationally rep- 
resentative, U.S. cohorts: preschool is positively associated with academic outcomes and negatively associated 
with behavioral outcomes both at school entry and as children progress through school. Heterogeneity is doc- 
umented with respect to child and preschool characteristics. However, there is no evidence that associations 
between preschool and medium-term child outcomes differ by elementary school characteristics. 


During the first few years of life, children’s brains 
are uniquely influenced by contextual factors, 
inputs, and stimulation (Knudsen, Heckman, 
Cameron, & Shonkoff, 2006). Early childhood inter- 
ventions, therefore, have the potential to alter chil- 
dren’s developmental trajectories and, in turn, 
improve their life outcomes. Indeed, a large and 
growing body of research has established the 
impact of high-quality preschool participation. 
Short-term benefits on early cognitive skills and 
school readiness have been well documented both 
in the United States (Yoshikawa et al., 2013) and 
internationally (Ruhm & Waldfogel, 2012). Studies 
have also demonstrated striking long-term effects of 
early childhood programs on health, educational 
attainment, and earnings (Campbell et al., 2012; 
Havnes & Mogstad, 2011; Schweinhart et al., 2005). 
A major puzzle in this literature, however, is the 
rapid “fade out” of the initial academic benefits of 
preschool as children progress through the primary 
grades of schooling (see Gibbs, Ludwig, & Miller, 
2011; Claessens, Engel, & Curran, 2014 for reviews). 

Two recent experimental studies of large-scale 
early childhood programs, Head Start and 
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Tennessee’s Voluntary Pre-Kindergarten, have found 
benefits at kindergarten entry that rapidly diminish 
in the first years of elementary school (Lipsey, 
Farran, & Hofer, 2015; Puma et al., 2012). Research- 
ers, policymakers, and practitioners have struggled 
to reconcile this observed fade out with the robust 
body of research, showing that the benefits of pre- 
school can persist well into adulthood (Deming, 
2009; Ludwig & Miller, 2007). There is strong inter- 
est in uncovering why convergence in outcomes 
between preschool participants and nonparticipants 
occurs (e.g., Do elementary school teachers focus 
attention on preschool nonparticipants thus helping 
them catch up? Are there spillovers between partici- 
pants and nonparticipants? Yoshikawa et al., 2013). 
The empirical evidence on these questions is limited, 
and substantial gaps remain in our understanding 
of the conditions that support persistent preschool 
benefits. 

A limitation of the current evidence base is the 
lack of research examining this issue with recent, 
nationally representative data. This is an important 
gap because the early childhood landscape has 
changed considerably since 1998, when the first 
nationally representative study of kindergarten 
entrants took place. Since then, enrollment in 
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state-funded preschool has nearly doubled, and the 
visibility of early childhood education has grown 
(Barnett et al., 2017). 

Our study aims to fill this gap. We leverage two 
cohorts of the Early Childhood Longitudinal Study— 
Kindergarten cohort (ECLS-K) to assess whether 
associations between preschool participation and 
child outcomes, both at school entry and through 
the third grade, have changed over time. These 
large, nationally representative data sets track 
kindergarten cohorts from 1998 and 2010 and 
include comparable information, allowing us to test 
whether the initial associations between preschool 
participation and child outcomes for children in the 
United States have diminished or grown. We also 
conduct the first investigation of changes in the per- 
sistence or fade out of these associations, tracking 
patterns through the spring of third grade across 
two different cohorts of kindergarten children. 

Finally, our analysis adds to a limited, but grow- 
ing, literature exploring heterogeneity in preschool 
fade out. We examine whether patterns of persis- 
tence or fade out differ across three theoretically 
motivated dimensions: (a) child and family demo- 
graphic characteristics; (b) characteristics of the pre- 
school experience; and (c) characteristics of the 
subsequent schooling experience. Understanding 
whether and how the persistence of preschool 
effects varies is important for identifying strategies 
for early interventions with lasting impact. 

Although existing studies have explored a subset 
of our research questions using the first ECLS-K 
(Loeb, Bridges, Bassok, Fuller, & Rumberger, 2007; 
Magnuson, Ruhm, & Waldfogel, 2007a, 2007b), the 
current study synthesizes work in a single, more 
comprehensive study, replicating the earlier find- 
ings, considering additional hypotheses, and explor- 
ing whether patterns uncovered in the earlier wave 
are still present in a comparable but more current 
data set. 


Background 


Theories of human development from both devel- 
opmental psychology and economics provide useful 
lenses for examining the relation between preschool 
and children’s skill development (Duncan & Mag- 
nuson, 2013). Bioecological theory centers around 
“proximal processes” and suggests that optimal 
development occurs when children experience sup- 
portive proximal processes over an extended period 
(Bronfenbrenner & Morris, 2006). The theory sug- 
gests that it is important to understand interactions 


between characteristics of the child, the preschool, 
and the multiple other environments children expe- 
rience (Blair & Raver, 2012). 

The cumulative model of human capital acquisi- 
tion (Cunha & Heckman, 2007) asserts that skills 
produced in one stage of development amplify skill 
development in a later period. This notion of com- 
plementarity suggests that the benefits of preschool 
may be enhanced when followed up by high-qual- 
ity, enriched environments. In contrast, develop- 
mental models allow for a compensatory role of 
subsequent environments in which the benefits of 
an enriched environment are most pronounced for 
children with the least prior exposure to such envi- 
ronments (Ramey & Ramey, 1998). While comple- 
mentary and compensatory models yield different 
predictions about the persistence of preschool 
effects over time, both imply that preschool benefits 
will vary by characteristics of the child, preschool, 
and subsequent schooling. 


Empirical Evidence on the Effects of Preschool 


Two well-known and _ oft-cited experiments 
demonstrated that early childhood programs can 
yield large, lasting benefits into adulthood (Camp- 
bell et al., 2012; Schweinhart et al., 2005). It is 
unclear, however, to what extent the findings from 
these small, decades-old studies generalize to pre- 
sent-day contexts. Most study participants were 
Black children living in poverty. The preschool 
experiences were more intensive than most pro- 
grams today and the comparison group generally 
stayed home or with relatives. In contrast, two 
thirds of 4-year-old children in the United States in 
2014 were enrolled in an early childhood education 
program (Kena et al., 2016). 

Recent studies from the United States and 
abroad demonstrate that participation in scaled-up 
preschool programs yields sizable short-term bene- 
fits in both literacy and mathematics (Berlinski, 
Galiani, & Gertler, 2009; Esping-Andersen et al., 
2012; Phillips et al., 2017; Wong, Cook, Barnett, & 
Jung, 2008). There is also empirical evidence that 
these benefits can persist into the primary grades, 
adolescence, and adulthood (Ladd, Muschkin, & 
Dodge, 2014; Ludwig & Miller, 2007; Reynolds, 
Temple, White, Ou, & Robertson, 2011). Indeed, 
studies of program expansion and availability in 
India, Norway, Sweden, and Uruguay all found 
impacts into adolescence (Berlinski, Galiani, & 
Manacorda, 2008; Black, Devereux, Loken, & Sal- 
vanes, 2014; Fredriksson, Hall, Johansson, & Johans- 
son, 2010; Hazarika & Viren, 2010). Taken together, 


these studies demonstrate that across widely rang- 
ing contexts, large-scale programs can have impor- 
tant short- and long-term benefits. Importantly, the 
majority of existing evidence examined means- 
tested or targeted programs, which may yield 
different results than the average formal early child- 
hood care program in the United States 

Despite compelling evidence of long-term bene- 
fits (Dumas & Lefranc, 2012; Havnes & Mogstad, 
2011), a recurring finding is that the short-term ben- 
efits, particularly on academic skills, dissipate in 
elementary school (Camilli, Vargas, Ryan, & Bar- 
nett, 2010; Leak et al., 2012). In the United States, 
fade out has been documented in Head Start pro- 
grams (Deming, 2009; Puma et al., 2012) and state 
prekindergarten (Lipsey, Hofer, Dong, Farran, & 
Bilbrey, 2013). Magnuson et al. (2007b) also docu- 
mented fade out for a national sample using the 
ECLS-K 1998. 


Heterogeneity in Preschool Effects 


In trying to understand both the immediate 
effects of preschool participation and the causes of 
fade out, researchers have attempted to identify 
whether there are particular groups for whom the 
benefits of preschool are larger and more persistent 
or whether there are particular characteristics—ei- 
ther of the preschool or the subsequent schooling 
environments—that lead to greater, more long-last- 
ing program impacts. 

Differences in preschool effects by child characteris- 
tics. | While children benefit on average from early 
childhood program participation, there is evidence 
that the magnitude of impacts varies across groups. 
In line with predictions from compensatory models, 
researchers have found evidence of more pro- 
nounced benefits at school entry among low-income 
children (Weiland & Yoshikawa, 2013), Hispanic 
children (Gormley, 2008), and Black children (Bas- 
sok, 2010). There is also heterogeneity in the med- 
ium- and longer-term impacts of preschool by 
socioeconomic status (SES) and race (Cascio & 
Schanzenbach, 2013; Garces, Thomas, & Currie, 
2002). In keeping with this earlier work, we hypoth- 
esize that the association between preschool and 
subsequent outcomes will be larger among low- 
income, Black, and Hispanic children. 

Differences in preschool effects by program character- 
istics. | A large body of research has demonstrated 
variation in preschool effects depending on proximal 
measures of classroom quality such as teacher-child 
interactions (Araujo, Carneiro, Cruz-Aguayo, & 
Schady, 2016; Mashburn et al., 2008). Unfortunately, 
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in the current study, measures of proximal preschool 
quality are unavailable. However, we do consider 
heterogeneity with respect to two program charac- 
teristics with empirically demonstrated links either 
to preschool quality or to child outcomes: public 
funding and length of day. Because observable 
measures of quality in public settings are systemat- 
ically higher (Bassok, Fitzpatrick, Greenberg, & 
Loeb, 2016), one plausible hypothesis is that both 
the initial benefits and their persistence would be 
more pronounced in these more highly regulated 
settings. 

Attending a program a few hours per week may 
yield quite different effects than attending full time 
(Robin, Frede, & Barnett, 2006). Children who spent 
more hours in preschool had higher test scores at 
the start of kindergarten (Loeb et al., 2007), but 
longer preschool days were also associated with 
increases in behavioral problems (Vandell, Belsky, 
Burchinal, Steinberg, & Vandergrift, 2010). We, 
therefore, hypothesize positive associations between 
preschool length of day and academic outcomes 
but negative associations with behavioral measures. 
Magnuson et al. (2007b) found no evidence that the 
relation between preschool and academic outcomes 
differed depending on the length of the preschool 
day, but that study did not consider behavioral out- 
comes. 

Differences in preschool effects by subsequent schooling 
environments. Early childhood advocates have 
called for preschool to third-grade (PreK-3) initia- 
tives, arguing that to sustain the benefits of a pre- 
school experience, children must have access to 
high-quality learning experiences in early elemen- 
tary school (Bogard & Takanishi, 2005). Recent 
work focuses on the importance of “sustaining 
environments,” or inputs and features of early 
schooling classroom experiences, as critical for the 
preservation of preschool effects (Bailey, Duncan, 
Odgers, & Yu, 2017; Phillips et al., 2017). There is 
conflicting evidence, however, on whether subse- 
quent experiences play a complementary or com- 
pensatory role. New research on Head _ Start 
indicates that the benefits of the early childhood 
program were more pronounced when followed 
by access to elementary schools with higher levels 
of funding (Johnson & Jackson, 2017). Relatedly, 
Reynolds, Ou, and Topitzes (2004) found that 
high-quality elementary schools mediated the long- 
term benefits of preschools. In contrast, Magnuson 
et al. (2007b) showed that the preschool test-score 
advantage was more persistent for children who 
subsequently attended classrooms with larger class 
sizes and lower levels of reading instruction. 
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The specific school characteristics used in the 
existing literature are a subset of the early elemen- 
tary school characteristics that have been shown to 
matter for learning during the primary grades. For 
instance, a number of studies have demonstrated 
that children benefit from full- rather than half-day 
kindergarten (Gibbs, 2014; Votruba-Drzal, Li-Grin- 
ing, & Maldonado-Carreno, 2008). Recent studies 
also demonstrate that children learn more in 
kindergarten classrooms that spend more time on 
advanced rather than basic math and literacy con- 
tent (Claessens et al., 2014; Engel, Claessens, & 
Finch, 2013), and that children benefit from kinder- 
garten teachers’ support of the transition into 
school (Schulting, Malone, & Dodge, 2005). 

Given the compelling evidence that early school- 
ing experiences (e.g., kindergarten class size) can 
have meaningful later-life implications, it is reason- 
able to investigate whether the association between 
preschool and children’s early elementary outcomes 
relates to subsequent kindergarten and primary 
grades experiences (Chetty et al., 2011). Despite the 
mixed empirical evidence to date, we hypothesize 
that schooling characteristics (e.g., full-day pro- 
grams, smaller class sizes, and more challenging 
curricula) play a compensatory role, thus catching 
up children with less enriched prior experiences 
and environments. 


The Current Study 


This study examines three primary research 
questions using data from two waves of the 
National Center for Education Statistics’ (NCES) 
ECLS: 


1. Do children who attended preschool in the 
year before kindergarten outperform children 
who did not participate in formal care with 
respect to academic or behavioral outcomes, 
both at school entry and through first and 
third grades? 

2. Do patterns differ across demographic groups 
as defined by race and ethnicity and SES? 

3. Do patterns differ by characteristics of the pre- 
school or subsequent school? 


Although each of these questions has been tack- 
led, to varying extents, with the earlier cohort of 
ECLS data, our analyses use both cohorts, and we 
discuss similarities, differences, and potential impli- 
cations for both developmental science and _ policy. 
Examining how these relationships changed over 
time is of particular interest given that the 12 years 


between the two ECLS-K cohorts considered were 
characterized by a heightened understanding of the 
importance of early childhood, as well as substan- 
tial expansion of public preschool access, height- 
ened focus on preschool quality, and marked 
changes in kindergarten learning environments 
(Bassok, Finch, Lee, Reardon, & Waldfogel, 2016; 
Bassok, Latham, & Rorem, 2016). 

A strength of the current analysis is the ability to 
track the associations between preschool and child 
outcomes through third grade, a focal year for poli- 
cymakers and practitioners under accountability 
systems that typically introduce standardized test- 
ing in that year. In addition, we provide new evi- 
dence on the extent to which patterns differ based 
on child, preschool, and subsequent schooling char- 
acteristics. 


Method 


This study leveraged data from two nationally rep- 
resentative samples of children entering kinder- 
garten in the fall of 1998 and 2010, respectively. 
The ECLS-K 1998 tracked children through eighth 
grade, and data collection for the more recent 
cohort is ongoing. In this study, we leverage data 
from the fall of kindergarten, as well as the spring 
of the kindergarten, first-grade, and third-grade 
years. The content and data collection procedures 
for the new cohort were modeled after the original 
ECLS-K and, as a result, these data sets provide a 
unique opportunity to compare the experiences of 
children in the United States over time. 


Participants 


The initial ECLS-1998 and ECLS-2010 samples 
consisted of approximately 21,400 and 18,150 chil- 
dren, respectively, rounded to the nearest 10 in 
keeping with NCES guidelines. To facilitate com- 
parison, both across waves of data collection and 
across cohorts, we restricted our sample to first- 
time kindergarteners with assessment data in the 
fall of kindergarten, spring of kindergarten, spring 
first grade, and spring third grade. Auxiliary analy- 
ses that include all children with a given test score, 
even if they do not have data at all time points, 
yield similar results. 

For comparability, we also limited our analysis 
to children who passed an English language 
screener. Children were administered an English 
language screener in both cohorts, but in 1998, 
children who failed the screener were not assessed 


in literacy at all, whereas in 2010, children who 
failed the screener but spoke Spanish were given a 
Spanish version of the assessment. Limiting the 
sample to children who passed the English assess- 
ment was necessary to ensure comparability across 
cohorts and to ensure that differences in patterns 
across academic literacy and math were not driven 
by differences in the groups who took each 
assessment. 

Relative to the analytic sample, children 
excluded from our sample were more likely to 
come from low-income families and to be Hispanic. 
Thus, our sample restrictions have implications for 
the external validity of our study, a point we 
address in several ways and revisit in the discus- 
sion. For instance, because all Spanish-speaking 
children, irrespective of their performance on the 
language screener, were assessed in math, we run 
supplementary models with math score outcomes 
for this broader group of Hispanic children. 

All analyses are estimated using weights devel- 
oped as part of the ECLS-K studies to account for 
nonrandom selection and attrition. Specifically, we 
chose weights that accounted for missingness in 
direct child assessment data and child characteris- 
tics, such as age, race and ethnicity, and sex. Where 
possible, we also chose weights that accounted for 
missing parent-reported data at baseline. The speci- 
fic weights we used in 1998 and 2010, respectively, 
were fall kindergarten—BYCWO & W1_2P0; spring 
kindergarten—BYCWO & W41_2P0; spring first— 
C124CW0 & W4C4P_20; spring third—C1_5FCO & 
W7C7P_20. 

We conducted multiple imputation using 
chained equations to avoid the bias that may arise 
when analyzing complete-case data. Our imputa- 
tion model, following Von Hippel (2007), accounted 
for all covariates included in our analysis (ie., 
demographics, preschool participation, and vari- 
ables listed in Appendix S1, Table A). Dependent 
variables were included in the imputation, but we 
did not use imputed values for dependent vari- 
ables. We generated 20 imputed data sets. 

Since the sample of children who had valid liter- 
acy and math assessments in each cohort is sub- 
stantially larger than the sample who had valid 
behavioral assessments, we constructed separate 
“academic” and “behavioral” samples. Our aca- 
demic samples consisted of 10,400 and 8,370 chil- 
dren in the 1998 and 2010 cohorts, respectively. The 
behavioral samples consisted of 7,850 and 6,890 
children. Analyses on a fixed sample of children 
with both academic and behavioral outcomes 
yielded substantively similar results. 
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Measures 
Preschool Experience 


During the fall kindergarten data collection, par- 
ents were asked whether their child attended a 
“day-care center, nursery school, preschool, or 
prekindergarten program” in the year before 
kindergarten and how many hours per week they 
attended. We categorized students as having 
attended “preschool” if they attended any of these 
programs for 5 or more hours per week. Children 
who attended fewer than 5 hr were excluded due 
to limited exposure, though including them did not 
substantively change our results. 

Consistent with earlier studies leveraging the 
ECLS data (e.g., Loeb et al., 2007), we defined “pre- 
school” to include a broad set of classroom-based 
early childhood education experiences, excluding 
Head Start. There are substantial differences in how 
questions about Head Start participation were asked 
across cohorts. In 1998, parents were asked questions 
about their child’s enrollment in Head Start, sepa- 
rately from the set of questions about other forms of 
preschool participation. In contrast, in 2010, there 
was no separate survey component about Head Start 
participation. Instead, parents were only asked 
whether any of the time their children spent in a pre- 
school setting was spent in Head Start. 

To address this discrepancy, we constructed 
comparable variables in both cohorts that indicated 
whether a child attended any Head Start in the year 
before kindergarten. Children who attended any 
Head Start in the prior year were excluded from 
our “preschool” group. We did include a Head 
Start indicator in all of our analyses. Our excluded 
group included all children who did not attend pre- 
school or Head Start. This group was made up of 
children who received nonparental care that 
occurred in a home (“nonparental, home-based 
care”), such as family child-care homes, babysitters, 
and relative care, and it also included children who 
received exclusive parental care (“only parent 
care”). 

This specification allowed us to identify the asso- 
ciation between preschool participation and child 
outcomes between children who went to any for- 
mal preschool arrangement excluding Head Start 
and those who had no formal care experience at all. 
We also ran specification checks in which our com- 
parison group was restricted to children exclusively 
in parental care. 

Public and private preschool. | Our broad defini- 
tion of preschool participation may mask important 
differences across types of preschool. For instance, 


6 Bassok, Gibbs, and Latham 


publicly funded programs generally face higher 
quality regulations, offer warmer and more edu- 
cated teachers, and are associated with larger learn- 
ing gains (Bassok, Fitzpatrick, etal, 2016). 
Unfortunately, accurately identifying preschool 
types from parent-reported data is notoriously diffi- 
cult, and due to changes in survey items across the 
two ECLS cohorts, it is also impossible to disaggre- 
gate the preschool group in exactly the same way 
over time. Despite these limitations, we disaggre- 
gated our broad “preschool” category into two 
mutually exclusive types: “public” and “private” 
preschool. In 1998, we defined public preschool to 
include any preschool that was either free or 
located in a public school. In 2010, public preschool 
was defined as any preschool that parents identi- 
fied as “public prekindergarten” or that was located 
in a public school. All preschool programs not clas- 
sified as public were categorized as_ private. 
Although this disaggregation is imperfect, our rates 
of public preschool participation (shown in Table 1) 
are comparable to, though lower than, those 
reported in the National Household Education Sur- 
veys and the National Institute for Early Education 
Research State of Preschool yearbooks over similar 
time periods, and all three sources indicate a 


Table 1 


substantial increase in publicly funded preschool 
over the study period. 

Part-time and full-time preschool. | We also con- 
structed a measure of preschool intensity, disag- 
gregating our preschool measure into “part time” 
and “full time” based on the number of hours per 
week that children attended. Following Magnuson 
et al. (2007b), we defined full-time preschool as 20 
or more hours per week and part-time preschool 
as between 5 and 20 hr per week. Children who 
attended multiple preschools were classified based 
on total hours per week across arrangements. We 
explored the robustness of our findings to differ- 
ent definitions of part time and full time, includ- 
ing using thresholds of 25 and 30 hr per week. 
Results were strikingly similar regardless of the 
definition. 


Outcomes 


Academic outcomes were drawn from direct 
assessments of student literacy and math skills, 
conducted in the fall and spring of kindergarten, 
and in the spring of first and third grades. Fall 
assessments were conducted between August and 
mid-December of the kindergarten year. Spring 


Early Childhood Experiences and Subsequent Classroom Experiences by Subgroup 


All students 


1998 2010 
Child care 

Preschool 0.56 0.56 
Center-based care 0.46 0.37 
Public pre-K 0.11 0.19 
Part time 0.31 0.28 
Full time 0.25 0.28 
Head start 0.13 0.13 
No formal care 0.31 0.31 
Nonparental, home-based care 0.13 0.12 
Only parent care 0.18 0.19 

Moderators 
Kindergarten class is full day 0.55 0.80 
Kindergarten transition practices 3.21 3.08 
Exposure to advanced literacy content 0.36 0.64 
Exposure to advanced math content 0.23 0.35 
Child’s K class was < 20 students 0.51 0.50 
All classes K & 1 were < 20 students 0.34 0.33 
All classes K, 1, & 3 were < 20 students 0.23 0.20 
N 10,400 8,370 


Low SES Black Hispanic 
1998 2010 1998 2010 1998 2010 
0.26 0.28 0.43 0.37 0.44 0.41 
0.14 0.09 0.25 0.18 0.29 0.21 
0.12 0.18 0.17 0.19 0.15 0.20 
0.11 0.11 0.11 0.08 0.22 0.19 
0.14 0.17 0.32 0.29 0.22 0.22 
0.33 0.27 0.34 0.31 0.17 0.19 
0.41 0.45 0.23 0.32 0.39 0.39 
0.13 0.16 0.10 0.14 0.15 0.14 
0.27 0.30 0.13 0.18 0.24 0.25 
0.65 0.90 0.79 0.94 0.49 0.84 
2.93 2.91 2.78 2.94 2.90 2.79 
0.38 0.63 0.43 0.70 0.41 0.65 
0.24 0.34 0.26 0.36 0.25 0.34 
0.51 0.46 0.48 0.52 0.49 0.45 
0.36 0.30 0.34 0.38 0.32 0.24 
0.25 0.18 0.23 0.24 0.23 0.15 
1,730 1,270 1,340 930 1,310 1,590 


Note. Preschool and Head Start are mutually exclusive; students who attended more than one type of care are classified as Head Start 
students. Part-time care is defined as < 20 hr per week. These descriptive statistics refer to the “academic” sample described in text. 
Sample sizes rounded to nearest 10 as per National Center for Education Statistics requirements. SES = socioeconomic status. 


assessments were conducted between March and 
June. 

The language and literacy (“literacy”) assessment 
was designed to measure basic skills such as letter 
recognition and print familiarity along with vocabu- 
lary and listening comprehension. The math assess- 
ment measured conceptual knowledge, procedural 
knowledge, and problem-solving ability. To mini- 
mize the burden of the assessments, children first 
took a routing test and were then given an easy, 
medium, or hard test based on their score. Scores 
were equated using item response theory (IRT). The 
reliabilities for these IRT-based assessments were 
quite high in both 1998 and 2010 (between .93 and 
.95 for literacy and between .92 and .94 for math). 
Literacy and math outcomes were standardized to 
have mean 0 and standard deviation (SD) 1, within 
the “academic” sample described earlier and sepa- 
rately for each cohort. 

In keeping with the existing ECLS-K literature, 
we drew our behavioral outcomes from teacher 
reports (Loeb et al., 2007; Magnuson et al., 2007a). 
We considered externalizing behavior and self-con- 
trol, two measures adapted from the Social Skills 
Rating Scale (Gresham & Elliott, 1990), both of 
which have high reliability (ranging from .79-.90 in 
1998 to .79-.88 in 2010). The externalizing behavior 
scale asked how often children argued, fought, got 
angry, acted impulsively, or disturbed classroom 
activities. On this scale, higher scores represent 
more negative behavior. The self-control scale mea- 
sured whether children respected others’ property 
rights, controlled their temper, accepted peer ideas, 
and responded appropriately to peer pressure. 
Higher scores represent more positive behavior. 
Behavioral outcomes were standardized to have 
mean 0 and SD 1, within the “behavioral” sample 
described earlier and separately by cohort. 

Additional details regarding the psychometric 
properties of all measures are reported in Rock and 
Pollack (2002) for the 1998 cohort and Tourangeau 
et al. (2013) for the 2010 cohort. 


Subsequent School Characteristics as Moderators 


We explored interactions between preschool par- 
ticipation and five characteristics of children’s sub- 
sequent school environments to determine whether 
these factors moderated fade out. First, we consid- 
ered whether a child’s kindergarten classroom was 
full day. Following the existing literature, we 
defined a “full-day” kindergarten classroom to be 5 
or more hours per day (Gibbs, 2014; Votruba-Drzal 
et al., 2008). Next, we considered the transition 
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practices that were used by each child’s kinder- 
garten teacher, which we employed as a proxy for 
purposeful alignment between the preschool and 
kindergarten experience. Kindergarten teachers 
were asked whether they used each of the follow- 
ing six transition practices: sending information 
about kindergarten home to parents of preschool- 
ers, visits to the kindergarten classroom for both 
preschoolers and their parents, shortened school 
days at the beginning of the kindergarten year, tea- 
cher visits to children’s homes at the beginning of 
the kindergarten year, and parent orientation prior 
to the school year. We consider the total number of 
transition practices employed by each teacher (0-6). 

Next, we construct two measures of children’s 
exposure to advanced kindergarten classroom con- 
tent, one each for literacy and math. In the spring 
of kindergarten, teachers were asked how often 
they taught a wide variety of literacy and math 
skills and also had the option to indicate that a par- 
ticular skill was not taught until a later grade. We 
defined “advanced” content as skills that at least 
25% of teachers in 1998 indicated were not taught 
until a later grade. The following six literacy skills 
met this criterion: composing and writing complete 
sentences; composing and writing stories with an 
understandable beginning, middle, and end; con- 
ventional spelling; reading multi-syllable words; 
alphabetizing; and reading aloud fluently. The fol- 
lowing seven math skills also met this criterion: 
counting beyond 100, writing all numbers between 
1 and 100, place value, reading three digit numbers, 
fractions, estimating probability, and writing math 
equations to solve word problems. 

Our measures of exposure to advanced literacy 
and math content are defined as the proportion of 
these advanced skills that were taught at least 
weekly in children’s classrooms. For example, if a 
child’s teacher taught two of six advanced literacy 
skills at least weekly, that child’s value for exposure 
to advanced literacy content would be 2/6 or .33. 

Finally, we constructed three measures to indi- 
cate the subsequent class sizes that children experi- 
enced. We defined a small class as 20 or fewer 
students (e.g., Blatchford, Moriarty, Edmonds, & 
Martin, 2002) and constructed three indicators to 
measure a child’s exposure to small class sizes in 
the primary grades. The first is an indicator for 
whether a child attended a kindergarten class with 
20 or fewer students. The second is an indicator for 
both the kindergarten and first-grade classes having 
20 or fewer students, and the third is an indicator 
for the kindergarten, first-grade, and third-grade 
classes all having 20 or fewer students. 
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Control Variables 


We included a rich set of covariates contained in 
both ECLS-K data sets to account for nonrandom 
sorting into preschool. We controlled for children’s 
age (at kindergarten entry and at assessment), sex, 
race and ethnicity, SES, parental education (both 
mother’s and father’s), maternal age, family compo- 
sition, and whether English is the primary language 
spoken at home. We also controlled for region of 
the country and urbanicity. Appendix $1, Table A 
provides a complete list of these controls. 


Analytic Approach 


Following previous literature (e.g., Loeb et al., 
2007; Magnuson et al., 2007b), we used ordinary 
least squares (OLS) to estimate the association 
between preschool participation and child out- 
comes. For each outcome, we estimated three sets 
of regressions, one that treated preschool as a single 
construct, one that separated preschool into private 
and public, and one that separated preschool into 
part and full time. These equations took the forms: 


Y; = By + B;PRESCHOOL; + yjXj+e (1) 
Yi = By + 6, PRIVATE; + B,PUBLIC; + y;Xi + € (2) 
Yi = Bo + BxPART; + By9FULL; + yjXy+ i, (3) 


where Y is the outcome of interest for individual 
child i, PRESCHOOL is an indicator that takes on a 
value of one if the child’s care experience in the 
year before kindergarten meets the definition of 
preschool and zero otherwise, and X is a vector of 
covariates. X includes an indicator for whether the 
child attended Head Start in the year prior to 
kindergarten, such that the omitted category is chil- 
dren who did not attend any formal care in the 
year before kindergarten. 

In Models 2 and 3, in which we disaggregate 
PRESCHOOL into its component parts, the key 
coefficients of interest (6; and B2) measure the asso- 
ciation between a particular type of preschool expe- 
rience (e.g., public or full-day) relative to the 
omitted category. We also report whether there are 
statistically significant differences between these 
two coefficients. 

To account for the nested structure of the data 
and the possibility of correlated errors across indi- 
viduals, all models include heteroskedasticity-robust 
standard errors clustered at the kindergarten class- 
room level. We estimated Models (1-3) four times 


for each outcome variable, once each for fall kinder- 
garten, spring kindergarten, spring first grade, and 
spring third grade. As a robustness check, we also 
re-estimated all of our models using a propensity 
score matching approach. Results (available on 
request) were consistent with the OLS estimates. 

To explore heterogeneity with respect to child 
characteristics, we reran all analyses by demo- 
graphic subgroups, restricting the sample to stu- 
dents who are Black, Hispanic, or low SES. 

Finally, to explore whether the association 
between preschool participation and child outcomes 
differed for children depending on their subsequent 
schooling experiences, we estimated a series of 
models in which we allowed for an interaction 
between preschool and one potential moderator. 
We specified these interacted models as follows: 


Yi = By + B; PRESCHOOL; + B,Mod; 
+ B3PRESCHOOL x Mod; + y;Xij + §; 


Mod was a measure of child i’s subsequent expe- 
riences in school. PRESCHOOL x Mod was the 
interaction term of preschool and subsequent expe- 
rience, and X was a vector of covariates. In Equa- 
tion (4), Bs is the coefficient of interest, capturing 
the composite relation of preschool participation 
and subsequent kindergarten experiences. 

We refer to our findings as the associations 
between preschool participation and child out- 
comes. To the extent that selection into the initial 
preschool experience was confounded by unobserv- 
able characteristics over and above those included 
in our vector of covariates, our coefficients may be 
biased estimates of the impact of preschool. That 
said our analytic approach and reliance on the rich- 
ness of the ECLS data sets to address selection bias 
are consistent with previous studies employing the 
1998 data to explore preschool effects. 


Results 
The Early Childhood Landscape, 1998 and 2010 


Table 1 shows the proportion of children that 
attended preschool, both overall and disaggregated 
by type (private and public) and length of day (part 
and full time). Participation in preschool and in 
Head Start was strikingly stable over the period 
examined. In both cohorts, just fewer than 70% of 
first-time kindergarteners were enrolled in either 
preschool or Head Start in the year prior to kinder- 
garten entry. The lack of overall increase is notable 
given heightened public investment in preschool. 


Indeed, our results show that over the study period 
public preschool participation nearly doubled, from 
11% to 19%, while private preschool participation 
dropped by 9 percentage points. Participation in 
full-time preschool rose by 3 percentage points. 

The remaining columns in Table 1 disaggregate 
patterns by demographic subgroups. In both peri- 
ods, Black, Hispanic, and low-income children were 
less likely to attend (non-Head Start) preschool than 
the average sampled child. In 2010, for example, 
56% of the sample attended preschool compared 
with 41% of Hispanic children, 37% of Black chil- 
dren, and 28% of children in the bottom SES quin- 
tile. The percentage of Black children enrolled either 
in preschool or Head Start dropped from 77 to 68, 
and there was also a 4 percentage point decrease 
among low-SES children. Relative to 1998 then, 
Black and low-SES children in 2010 were more 
likely to use home-based care or to be cared for 
only by their parents. 

Table 1 also provides descriptive statistics about 
the subsequent schooling experiences of each cohort. 
Full-day kindergarten participation increased over 
this timeframe, from 55% in 1998 to 80% in 2010. This 
increase was particularly pronounced among His- 
panic children, whose participation in full-day 
kindergarten rose by 35 percentage points. There 
was also a sizable increase in exposure to advanced 


Table 2 
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literacy content. The proportion of advanced literacy 
skills that children were exposed to weekly increased 
from 36% to 64%. There was a smaller but still nota- 
ble increase in exposure to advanced math content. 
Overall, the likelihood of being in a small classroom 
(< 20 students) remained similar over time; however, 
the data suggest a dip in the likelihood low-income 
and Hispanic children attended a small class. 


Preschool Participation and Children’s Academic and 
Behavioral Outcomes 


To explore the relations between preschool par- 
ticipation and academic and behavioral outcomes, 
we estimated the models described in Equations 
(1-3) for literacy and math in 1998 and 2010. The 
regression results for academic outcomes are pre- 
sented in Table 2, and Table 3 shows results from 
analogous models predicting behavioral outcomes. 


Academic Outcomes 


In keeping with earlier studies using the ECLS- 
K, we find that in 1998, there are positive associa- 
tions between preschool participation and children’s 
literacy and math outcomes at school entry (Loeb 
et al., 2007; Magnuson et al., 2007a). This pattern 
holds in the 2010 data, and the magnitude of 


Associations Between Preschool Participation and Later Literacy/Math Scores, 1998 and 2010 


1998 2010 
Fall K Spring K Spring first Spring third Fall K Spring K Spring first Spring third 

Literacy 

Preschool .16 (.02)*** .09 (.02)*** .07 (.03)* .05 (.03) 15 (.03)*** — .09 (.03)** .06 (.03)* .04 (.03) 

Private .20 (.02)*** 13 (.03)*** 10 (.03)*** 10 (.03)*** = .17 (.03)*** 10 (.03)*** .07 (.04) -08 (.03)** 

Public .05 (.03) —.01 (.03) —.05 (.05) —.12* (.05) 12** (.03) 07 (.04) .04 (.04) —.02 (.04) 

Part-time care —_.17 (.03)*** 10 (.03)*** .08 (.03)** .06 (.03)* 16 (.03)"* 12 (.03)*** .09 (.04)* .06 (.03)* 

Full-time care —_.15 (.03)*** .09 (.03)** .05 (.03) .04 (.04) 15 (.03)** — .05 (.03) .03 (.04) .02 (.04) 

N 10,400 10,400 10,400 10,400 8,370 8,370 8,370 8,370 
Math 

Preschool 15 (.02)*** 12 (.02)*** .07 (.03)* .08 (.03)** 13 (.03)"* 06 (.03)* .07 (.03)* .06 (.03)* 

Private .20 (.02)*** .16 (.02)*** 11 (.03)*** 12 (.03)*** = .15 (.03)*** ~—.09 (.03)** .09 (.03)** .08 (.03)** 

Public .02 (.03) .00 (.03) —.06 (.04) —.05 (.05) .08 (.03)** -02 (.03) .04 (.04) .02 (.04) 

Part-time care —_.16 (.02)*** 12 (.03)*** .07 (.03)* .08 (.03)** 12 (.03)""* 06 (.03)* .08 (.03)** .06 (.03)* 

Full-time care —_.14 (.03)*** 12 (.03)*** .06 (.03)* .08 (.03)** 13 (.03)"* 06 (.03)* .07 (.04) .05 (.04) 

N 10,400 10,400 10,400 10,400 8,370 8,370 8,370 8,370 


Note. Outcomes have been standardized to have mean 0 and SD 1. All estimates control for a rich set of covariates, including student 
gender, race, SES, area of residence, and family composition. Estimates are weighted to be nationally representative of students entering 
kindergarten in each respective year. Sample sizes are rounded to the nearest 10 as per National Center for Education Statistics require- 
ments. Bolded sets of coefficients are statistically different from each other at the .05 level. SES = socioeconomic status. 


*p < 05. **p < 01. ***p < .001. 
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Table 3 


Associations Between Preschool Participation and Later Externalizing and Self-Control, 1998 and 2010 


1998 2010 
Fall K Spring K Spring first Spring third Fall K Spring K Spring first | Spring third 

Externalizing behavior 

Preschool .23 (.03)*** .23 (.03)*** .19 (.03)*** .12 (.04)** 11 (.03)*** 15 (.03)*** .09 (.03)** 312 (.03)"* 

Private .23 (.03)*** .22 (.03)*** 17 (.04)*** 11 (.04)** .12 (.04)** 15 (.04)*** .12 (.04)** 11 (.04)** 

Public .24 (.05)*** .26 (.05)*** .25 (.06)*** .16 (.06)** .09 (.04)* .13 (.04)** .05 (.04) .15 (.04)*** 

Part-time care .09 (.03)** .09 (.03)** .06 (.04) .04 (.04) .02 (.04) .05 (.03) .00 (.04) .03 (.04) 

Full-time care 41 (.04)*** 40 (.04)*** 35 (.04)*** .23 (.04)*** .20 (.04)*** .25 (.04)*** .19 (.04)*** .22 (.04)*** 

N 7,850 7,850 7,850 7,850 6,890 6,890 6,890 6,890 
Self-control 

Preschool —.14 (.03)"* = —.15 (.03)*** — —.15 (.03)*** — —.07 (.04) —.04 (.03) —.10 (.03)*** = —.08 (.03)** — —.10 (.04)* 

Private —.14 (.03)"* = —.14 (.03)*** — —.14 (.03)*** — —.07 (.04) —.05 (.04) —.10 (.04)* —.08 (.04)* —.06 (.04) 

Public —.13 (.05)** = —.19 (.05)***  —.18 (.06)** — —.04 (.06) —.04 (.04) —.10 (.04)* —.09 (.04)* —.15 (.04)*** 

Part-time care —.02 (.03) —.03 (.03) —.05 (.04) -03 (.04) .03 (.04) —.03 (.04) .00 (.04) —.01 (.04) 

Full-time care —.29 (.04)*** = —.31 (.04)*** = —.29 (.04)*** = —.18 (.04)*** = —.12 (.04)** —— —.17 (.04)*** = —.17 (.04)*** = —.19 (.04)*** 

N 7,850 7,850 7,850 7,850 6,890 6,890 6,890 6,890 


Note. Outcomes have been standardized to have mean 0 and SD 1. All estimates control for a rich set of covariates, including student 
gender, race, SES, area of residence, and family composition. Estimates are weighted to be nationally representative of students entering 
kindergarten in each respective year. Sample sizes are rounded to the nearest 10 as per National Center for Education Statistics require- 
ments. Bolded sets of coefficients are statistically different from each other at the .05 level. SES = socioeconomic status. 


*p < .05. **p < .01. ***p < .001. 


these initial associations is comparable across 
waves. 

We also observe that the initial association 
between preschool participation and literacy dimin- 
ishes rapidly as children proceed through the first 
years of elementary school. These findings replicate 
those already reported for the 1998 cohort (Magnu- 
son et al., 2007b). A key goal of the current study 
was to examine if those earlier patterns still hold in 
the more recent data. We find that the patterns are 
strikingly similar. For example, in 2010, the associa- 
tion between preschool participation and literacy 
outcomes fell from .15 SD to .09 SD between the 
beginning and end of kindergarten, and by third 
grade, the association was only .04 (and statistically 
indistinguishable from zero). The analogous coeffi- 
cients in 1998 were .16 SD, .09 SD, and .05 SD. Our 
results indicate that the associations between pre- 
school and both literacy and math outcomes, at 
both school entry and beyond, are extremely similar 
across cohorts. 

Next, we disaggregate the data by preschool 
type. In 2010, both private and public preschool 
participation is positively and significantly associ- 
ated with academic skills at kindergarten entry. 
Coefficients for private preschools are always larger 
than those for public preschools, though the differ- 
ences in coefficients are not always statistically dis- 
tinguishable. The associations between private 


preschool and literacy and math outcomes are still 
evident through the spring of third grade (.08 SD). 
In contrast, the association between public pre- 
school and child outcomes is no longer evident by 
the end of kindergarten. 

In 1998, the differences between private and pub- 
lic preschools were more pronounced. At kinder- 
garten entry, the private preschool coefficient for 
literacy was statistically significant and four times 
larger than the insignificant public preschool coeffi- 
cient (.20 and .05, respectively). By the end of third 
grade, children who had attended private preschool 
programs still outperformed similar children in 
informal care settings (.10 SD in literacy, .12 SD in 
math). In contrast, for public preschool, the compa- 
rable coefficients were negative and, in the case of 
literacy, statistically significant (—.12 SD in literacy, 
—.05 SD in math). 

In models that disaggregate preschool by length 
of day, the full and part-time coefficients were not 
statistically different from each other. That said, the 
point estimates for part-time care were generally 
larger and _ statistically significant through third 
grade. In contrast, in both waves, the association 
between full-time preschool and literacy outcomes 
was indistinguishable from zero, and the same pat- 
tern holds for math in 2010. 

Recall that in all models, coefficients are inter- 
preted relative to an omitted group which includes 


all children who experienced no formal preschool 
in the year prior to kindergarten. This category 
includes children who were either in home-based 
settings or were with their parents and experienced 
no regular out-of-home care. In specification checks 
(available upon request), we reran the same models 
but added an indicator for whether children 
attended home-based care. In these analyses, we 
compare outcomes for preschool attendees just to 
children who were in parental care. The patterns 
from these models are strikingly similar to those 
presented in Table 2, suggesting our results are not 
driven by our decision to include both groups in 
our control group. 


Behavioral Outcomes 


Preschool participants in both cohorts exhibited 
more externalizing behaviors and lower levels of 
self-control than peers who did not experience any 
formal care (Table 3). These patterns were evident 
in both cohorts and in nearly every wave. For 
instance, for the 2010 cohort, in the spring of third 
grade, preschool participants were rated as having 
higher levels of externalizing behavior (.12) and 
lower levels of self-control (—.12). 

Patterns do not systematically differ between pri- 
vate and public preschools (although the larger 
negative coefficient on “public preschool” in the 
model predicting third-grade self-control in 2010 is 
one exception). Patterns do differ by length of day. 
Part-time preschool participation is largely uncorre- 
lated with behavioral measures. In contrast, among 
full-time participants, coefficients are moderate in 
size and are evident in every wave through spring 
of third grade. 


Racial and SES Differences in the Associations Between 
Preschool and Child Outcomes 


Tables 4~7 show results from analyses examining 
whether either the initial association between pre- 
school participation and child outcomes, or its per- 
sistence, differed by SES or race and ethnicity. The 
standard errors in these analyses are larger due to 
reduced sample size, and in some cases, the cell 
sizes for these subgroup analyses may be small. 


Academic Achievement 


Across both cohorts, the relation between pre- 
school participation and academic outcomes was 
particularly pronounced for Black children. In 2010, 
Black preschool participants scored about .23 SD 
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higher in literacy and .28 SD higher in math at 
school entry (Table 4). They maintained a preschool 
advantage in both subjects through spring of first 
grade (third-grade estimates are comparable but no 
longer statistically significant). 

Among the low-income sample, our results indi- 
cate that the preschool advantage, evident at 
kindergarten entry in both literacy and math, dissi- 
pated rapidly (and was no longer statistically differ- 
ent from zero) by the spring of kindergarten. A 
similar pattern holds among the Hispanic sample. 
In 1998, the association between preschool and aca- 
demic outcomes is initially positive, but by the 
spring of first grade, it is no longer evident. In 
2010, the associations between preschool participa- 
tion and academic outcomes are not significant, 
even at kindergarten entry. 

As discussed earlier, for comparability, our His- 
panic subsample excludes children who did not 
pass an English language screener at kindergarten 
entry. However, all Hispanic children—irrespective 
of their performance on the language screener— 
took a math assessment. Appendix S1, Table B indi- 
cates that the associations between preschool partic- 
ipation and academic outcomes are somewhat 
larger in this broader group. Still, the coefficients 
are modest in size, and in the 2010 cohort, they are 
no longer statistically significant by the spring of 
kindergarten. 


Behavioral Outcomes 


Turning to the subgroup analyses for behavioral 
outcomes (Table 6 for 2010, Table 7 for 1998), we 
find suggestive evidence that the negative associa- 
tions between preschool and both externalizing and 
self-control are less pronounced for Black children 
in the more recent cohort. Among Black children in 
2010, preschool participation is not significantly 
associated with either behavioral outcome, at any 
wave. In the 1998 cohort, the associations between 
preschool participation and child outcomes were 
much more pronounced and significant at every 
wave. Similarly, the moderate positive association 
between preschool and _ externalizing behavior 
observed for low-income children in 1998 was not 
observed in 2010. 


Subsequent Schooling Environments as Potential 
Moderators 


Our analyses did not uncover any evidence that 
the five characteristics of children’s subsequent 
schooling (ie., length of day, class size, transition 
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practices, and exposure to advanced content in liter- 
acy or in math) moderated the relation between 
preschool participation and child outcomes for 
either cohort, at any wave. Some moderators (e.g., 
full-day kindergarten and exposure to advanced 
math content) were associated with child outcomes, 
but we observed no systematic interactions between 
preschool and these moderators. Results showing 
these interacted models for spring kindergarten out- 
comes in 2010 and 1998 are available in 
Appendix S1, Tables C and D. 


Discussion 


This study is the first to employ two large and very 
similar data sets to compare whether the associa- 
tions between preschool participation, broadly 
defined, and child outcomes have changed over 
time. Recent meta-analytic work has shown that the 
initial effects of preschool participation were more 
pronounced in preschool programs that began 
before 1980 relative to more recent programs (Dun- 
can & Magnuson, 2013). The current study assesses 
whether the trend toward smaller associations 
between preschool participation and child outcomes 
has continued in a more recent period, and because 
the two data sets utilized are so similar, we can 
rule out differences in measures or designs as dri- 
vers of any observed changes over time. 

We also examined whether associations persist 
through the end of third grade. While fade out of 
early childhood program effects has been docu- 
mented recently in studies of the Tennessee Volun- 
tary Pre-K program and of Head Start (Lipsey 
et al., 2013; Puma et al., 2012), as well as in previ- 
ous work leveraging the ECLS-K 1998 (Magnuson 
et al., 2007b), this is the first study to use similar 
data sets to assess whether patterns of fade out 
have changed over time. 

Finally, the study makes a contribution by 
exploring heterogeneity in the associations between 
preschool participation and child outcomes, focus- 
ing on three theoretically motivated dimensions: (a) 
demographic characteristics; (b) preschool charac- 
teristics; and (c) subsequent schooling environ- 
ments. By doing so, the study aims to empirically 
test hypotheses derived from bioecological theory, 
which imply that the association between preschool 
and learning depends on characteristics of the child, 
the preschool, and the multiple environments chil- 
dren experience. 

Although existing studies have already explored 
some of our research questions within the first 


ECLS data (e.g., Claessens et al., 2014; Loeb et al., 
2007; Magnuson et al., 2007b), the current study 
synthesizes that work in a single more comprehen- 
sive study, replicating the earlier findings, consider- 
ing additional hypotheses, and exploring whether 
patterns uncovered in the earlier wave differ in a 
comparable but more current data set. 


Preschool Participation and Subsequent Child Outcomes 


The two kindergarten cohorts we considered 
straddled a period characterized by significant 
increases in public interest and investment in early 
childhood (Barnett et al., 2017). Given the height- 
ened investment during this period, we hypothe- 
sized stronger associations between preschool and 
child outcomes in the more recent cohort. This is 
not what we found. 

As Figure 1 and Table 2 highlight, the patterns 
of association between preschool participation and 
academic outcomes in 2010 were strikingly similar 
to those observed in the 1998 cohort (which were 
documented previously in Magnuson et al., 2007b). 
In both cohorts, there were positive short-term asso- 
ciations between preschool participation and aca- 
demic skills, with effect sizes ranging from .13 to 
.16 SD across subjects and cohorts. In both cohorts, 
these positive associations also became meaning- 
fully smaller in magnitude as children progressed 
in school. Nevertheless, associations between pre- 
school and math outcomes remained positive and 
statistically significant through the spring of third 
grade, and in literacy, coefficients were statistically 
significant through the end of first grade. 

The associations between preschool participation 
and two teacher-reported measures of behavior 
(i.e., externalizing and self-control) were also largely 
consistent across waves. These findings echo earlier 
work that documents a negative association 
between preschool participation and _ children’s 
behavior (Loeb et al., 2007; Magnuson et al., 2007a). 

The results indicate that in the 12-year period 
examined, the association between preschool and 
children’s outcomes neither narrowed, as it did 
over recent decades (Duncan & Magnuson, 2013), 
nor broadened, as might have been hoped given 
increased investment. 

That the associations are not larger in the second 
cohort does not necessarily imply that investments 
failed to yield benefits. The current study documents 
gaps in outcomes between children who did and did 
not experience preschool. Changes in these gaps 
over time could reflect changes in the average pre- 
school experience as well as changes in the 
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Figure 1. Association between preschool participation and literacy outcomes through third grade, across subgroups. 
Note. All coefficients are reported as effect sizes in standard deviation (SD) units. Error bars represent 95% confidence intervals. 


experiences of children who did not attend pre- 
school. Indeed, a number of recent studies have 
highlighted the importance of understanding the 
counterfactual experience when investigating the 
impact of preschool programs (Zhai, Brooks-Gunn, 
& Waldfogel, 2014). Bassok, Finch, et al. (2016) show 
that over the same period tracked in the current 
study, children’s exposure to learning experiences at 
home increased substantially (e.g., reading with their 
parents or playing computer games focused on liter- 
acy and math). There may not be changes over time 
in the relative advantage of preschool if both pre- 
school participants and nonparticipants are having 
more supportive experiences than they once did. 
More research is needed to better understand how 
the experiences of children in informal care arrange- 
ments have changed over time. 


Heterogeneity in the Association Between Preschool and 
Child Outcomes 


In addition to describing overall associations 
between preschool participation and child outcomes, 


we also explored whether these patterns differed 
across three dimensions: (a) demographic character- 
istics, (b) preschool type, and (c) subsequent kinder- 
garten experiences. 


Demographic Characteristics 


Consistent with earlier work, we find the associ- 
ations between preschool participation and child 
outcomes—both at school entry and subsequently— 
are particularly pronounced for Black children (Bas- 
sok, 2010). Unlike in the full sample, for which the 
preschool coefficients dissipated rapidly, among 
Black children the associations between preschool 
participation and child outcomes remain relatively 
stable in magnitude as children proceed through 
school. 

Our findings also provide suggestive evidence 
that among Black children the negative associations 
between preschool and children’s behavior have 
diminished over time. In 1998, teachers rated Black 
children who had attended preschool as having 
much higher levels of externalizing behavior and 
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lower levels of self-control, compared with similar 
Black children who did not experience formal care 
(.47 SD and —.34 SD, respectively). In 2010, the 
magnitude of the coefficients was notably smaller 
at school entry (.18 SD and —.05 SD). 

These relatively encouraging results for the Black 
subsample aligned with a compensatory hypothesis 
that the associations between preschool and child 
outcomes would be larger for Black, Hispanic, and 
low-income children than their white or higher- 
income peers (Bassok, 2010; Duncan & Magnuson, 
2013; Ramey & Ramey, 1998). However, in the low- 
income and Hispanic subgroups, there is little sup- 
port for this hypothesis. For instance, among the 
low-SES group, the association between preschool 
participation and academic outcomes is fleeting and 
no longer evident at the end of the kindergarten 
year. 

For the Hispanic subgroup, in the more recent 
cohort, there is no association between preschool 
participation and literacy and math scores at any 
time point. One partial explanation for this surpris- 
ing pattern is that our Hispanic subsample excludes 
children who failed an English screener test, an 
important limitation, given that existing research 
suggests English language learners may experience 
pronounced benefits from preschool participation 
(Gormley, 2008). There are larger coefficients in 
models that leverage the full Hispanic sample, 
including children who failed the screener (see 
Appendix S1, Table B). However, even in this 
group, the association between preschool and math 
outcomes is small and only significant at school 
entry. These results are at odds with the existing lit- 
erature which has frequently shown larger benefits 
for low-income and Hispanic children (Gibbs, 2014; 
Yoshikawa et al., 2013). 


Preschool Type 


In both waves, the positive associations between 
preschool and academic outcomes are larger for 
children in private rather than public preschools. In 
fact, in 1998, we only observe this positive associa- 
tion among children enrolled in private settings. 
That said, the magnitude of this private-public dif- 
ferential has narrowed across cohorts. In 2010, there 
is no longer a statistically difference between pri- 
vate and public settings, in this association during 
the kindergarten year. There are generally no differ- 
ences between private and public settings with 
respect to the behavioral outcomes. 

The opposite pattern emerged when we turned 
to the length of the preschool day. There was no 


relationship between length of day and academic 
outcomes in either wave. However, the negative 
and persistent association between preschool partic- 
ipation and behavioral outcomes was driven, 
almost entirely, by children in full-day programs. In 
2010, we observed no negative associations with 
preschool participation and either externalizing 
behaviors or self-control, among children enrolled 
in part-time programs. For children in full-day pro- 
grams, we observe a meaningful, negative associa- 
tion for both outcomes, at all four time points 
considered. More pronounced negative associations 
between full-day preschool and behavioral out- 
comes are also evident when we disaggregate the 
analysis to focus on low-SES, Black and Hispanic 
children, though the differences between full and 
half-day programs are not always statistically sig- 
nificant in this context, due in part to smaller sam- 
ple sizes. We do observe that in 2010, the negative 
association between preschool participation and 
behavioral outcomes among Hispanic children per- 
sists through third grade and is primarily driven by 
children enrolled in full-day programs. 

Overall, our results regarding preschool type 
countered our hypotheses that public preschools, 
which face more stringent regulations, and full-time 
programs, which offer more dosage, would relate to 
more favorable outcomes for children. One possibil- 
ity is that the heterogeneity we observe is driven by 
differential selection (with higher-income children 
overrepresented in private and part-time programs). 
Although we control for a rich set of covariates, 
unobserved differences across these groups are 
likely, a point we return to next. On the other hand, 
it may be that, on average, the part-time and private 
programs in this data are of higher quality than the 
full-time or public programs. More research is 
needed to disentangle whether the heterogeneity 
observed is driven by differences in program quality 
or differences in selection. 


Kindergarten Characteristics 


A common hypothesis in discussions of pre- 
school fade out is that characteristics of subsequent 
schooling might play a role in sustaining preschool 
effects (Bailey et al., 2017; Reynolds, Magnuson, & 
Ou, 2010). The characteristics we considered in the 
current analysis, including full-day kindergarten, 
transition practices, exposure to advanced content, 
and class size, did not moderate the persistence of 
an association between preschool and child out- 
comes either in the spring of kindergarten or in 
subsequent waves. 


The lack of moderation does not suggest that 
these features of elementary schools are unimpor- 
tant. In fact, research has documented positive asso- 
ciations between each of these measures and child 
outcomes. The results only indicate that these mea- 
sures do not serve to moderate the fade out or per- 
sistence of preschool associations in the ECLS-K 
data. 

One explanation is that schooling environments 
do play a central role in sustaining preschool 
effects, but that our measures fail to capture the fac- 
tors that are most central. There is a need for 
research that more precisely measures the quality of 
early schooling experiences and identifies factors 
that play either compensatory or complementary 
roles with early childhood program participation. 
Studies currently in the field through the Institute 
of Education Sciences’ recently funded Research 
Network on Early Childhood Education could play 
a critical role in expanding our understanding of 
this issue. Further, in recent years, early elementary 
school experiences have changed substantially, with 
a greater emphasis on academic instruction, and an 
explicit focus on PreK-3 alignment (Bassok, Latham, 
et al., 2016). Research is needed to assess the impact 
of these changes on children’s development and to 
examine whether they have influenced the persis- 
tence of preschool effects. 

While more research is necessary to understand 
the role of elementary schools in sustaining the ben- 
efits of preschool, it is important to consider that 
focusing on subsequent environments may not be 
the only or best way to foster larger and longer- 
lasting preschool benefits. It is notable that the lack 
of support for “sustaining environments” in the 
current study echoes other recent work that also 
showed no evidence that subsequent schooling 
environments moderate preschool fade out (Claes- 
sens et al., 2014; Jenkins et al., 2016). As pointed 
out by Bailey et al. (2017) in addition to work on 
sustaining environments, more work is needed to 
understand how preschool programs can best influ- 
ence the type of skills that are less rote and more 
critical for individuals’ longer-term success. Under- 
standing the role of curricula, teacher—child interac- 
tions, and preschool professional development may 
help in those efforts. 


Study Limitations 


Although the ECLS provide a unique opportu- 
nity to assess changes in the association between 
preschool and child outcomes over time, the data 
have several limitations. First, although our overall 
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“preschool” measure and nearly all other variables 
were constructed in exactly the same way across 
the 1998 and 2010 data sets, a few notable differ- 
ences in survey items across cohorts limited our 
analysis. In particular, differences across surveys in 
measuring Head Start participation make it impos- 
sible to accurately examine whether the association 
between Head Start and child outcomes have chan- 
ged over time. Relatedly, differences in survey out- 
comes limited our ability to construct consistent 
definitions of “public” and “private” preschool 
across cohorts. We, therefore, interpret any compar- 
isons of these variables across cohorts with caution. 

Second, the ECLS-K provides a blunt measure of 
children’s preschool experiences. Parents may not 
accurately distinguish among care types when 
reporting early childhood experiences. Moreover, a 
large body of research from the United States and 
internationally has demonstrated the importance of 
preschool quality and, in particular, the importance 
of engaged and caring child—teacher interactions, in 
predicting preschool benefits (Araujo et al., 2016; 
Mashburn et al., 2008). Unfortunately, the ECLS-K 
has no measures of quality. Although collecting 
these data can be costly, funders of future large- 
scale studies of early childhood education should 
consider such an investment, as these data may 
meaningfully enhance our understanding of the 
conditions under which preschool benefits persist. 
The same is true for measuring subsequent school- 
ing environments. Rich measures of children’s expe- 
riences in elementary school may provide insights 
about the role of sustaining environments. 

Finally, the current study describes associations 
between preschool participation and child out- 
comes, but does not isolate the causal relationship 
between preschool and child outcomes. In supple- 
mentary analyses, we replicate our analyses using 
propensity score matching and find very similar 
patterns. We included a wide set of covariates in 
our analysis to account for factors that may be cor- 
related with preschool participation, preschool type, 
preschool length of day, or subsequent schooling 
environments. Still, if the extensive set of controls 
included in our models does not account fully for 
endogeneity—a possibility that is quite plausible— 
we cannot frame the relations documented in this 
study as causal. 

Nevertheless, the national scope of the data 
makes it an important resource for understanding 
the associations between preschool and child out- 
comes. The 1998 cohort of the ECLS data has been 
leveraged extensively in the literature to document 
the association between preschool participation and 
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child outcomes (Loeb et al., 2007; Magnuson et al., 
2007a, 2007b). Our study replicates findings from 
those studies and builds upon them. 


Conclusion 


Using two, large U.S. data sets, this study shows 
that preschool participation is associated with 
higher literacy and math scores at school entry. The 
magnitude of these associations shrinks quickly as 
children progress through school. Still, preschool 
attendees outperform their peers in literacy through 
the spring of first grade and in math through the 
spring of third grade (which is the latest year for 
which data are available). On the other hand, pre- 
school is associated with higher levels of externaliz- 
ing behavior and lower levels of self-control 
through third grade. 

Overall, patterns in 2010 mirrored those in 1998. 
While it is discouraging that the associations have 
not become more pronounced over a period charac- 
terized by heightened investments in early child- 
hood education, the fact they have not become less 
pronounced either, as predicted by some recent 
research, is heartening (Duncan & Magnuson, 
2013). The larger and more persistent preschool 
associations for Black children are encouraging as 
well. 

Still, this study leaves many questions unan- 
swered about the conditions under which scaled-up 
preschool can yield meaningful and sustained bene- 
fits. It provides a nationally representative look at 
the average preschool experience. The early child- 
hood landscape is varied, and recognizing that 
diversity, state policy efforts are increasingly ori- 
ented toward improvement. Studying the effects of 
these efforts to improve will prove important for 
the field. 
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